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PACKET COMES IN 



(54) Title: METHOD AND APPARATUS TO TRANSLATE DATA STREAMS AMONG MULTIPLE PARTIES 
(57) Abstract 

Multiparty communications are handled 
in a digital device according to a data struc- 
ture where a formatted packet from a particu- 
lar transmitter is translated into a shared format 
M which is then retranslated to various destina- 
tions. Handling of group address packets can be 
accomplished with customized circuitry. Flexi- 
bility is achieved by allowing parameters of the 
routing routine to be specified in memory which 
can be programmably altered. In a specific em- 
bodiment, the representation of a group is a cir- 
cular linked list Each party has one entry in 
the linked list, therefore the entire structure has 
N substructures for N participants. 
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METHOD AND APPARATUS TO TRANSLATE DATA STREAMS 
AMONG MULTIPLE PARTIES 

5 

This application claims priority from provisional 
patent application 60/030,728 filed 11/8/96, which is 
incorporated herein by reference. Related background 
information is discussed in related coassigned patent 
10 application serial number 08/ 437, AS.*? , filed September 15, 
1997, entitled METHOD AND APPARATUS TO IDENTIFY FLOWS IN DATA 
STREAMS, which is incorporated herein by reference and which 
was filed with a microfiche appendix of 169 frames on two 
sheets comprising a preliminary user manual and programming 
15 information for an apparatus related to the invention. This 
appendix is also incorporated by reference . 

A portion of the disclosure of this patent document 
contains material which is subject to copyright protection. 
The copyright owner has no objection to the facsimile 
20 reproduction by anyone of the patent document or the patent 
disclosure as it appears in the Patent and Trademark Office 
patent file or records, but otherwise reserves all copyright 
rights whatsoever. 

25 . BACKGROUND OF THE INVENTION 

The present invention relates to electronic circuits 
and to digital communication. More particularly, the present 
invention relates to an advanced method for handling data 
units (packets) within a communication device by efficiently 
30 translating data units to different formats among multiple 
parties using a simplified and efficient method. 

The present invention has a number of applications 
in advanced telecommunication systems and networks. One 
envisioned application of the invention is in a state-of-the- 
35 art router (or layer three switch) for handling data packets 
in multiparty communications. These data packets may be 
constructed according to a number of well-known packet 
transmission protocols in a layered protocol suite. Routers 
are packet switching devices characterized by their ability to 
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perform intelligent routing of packets on a per-packet basis. 
Routers generally can handle packets or frames of data 
formatted according to a number of different protocols. A 
layer three switch is a type of router that performs layer 
three routing of packets largely or exclusively using 
dedicated logic circuitry. 

Other applications of the invention include fast 
processing of any kind of discreet data unit streams quickly 
into multiple formats. 

Explanation of both the prior art and the invention 
will be better understood with reference to specific examples, 
however this should not be taken to limit the invention to the 
particular examples described. The invention is generalizable 
to other similar types of communication devices or to other 
computing devices handling data in ways that are analogous to 
data handling in modern networks. The invention should 
therefore not be limited except as provided in the attached 
claims* 

Networking Devices Standards 

This specification presumes familiarity with the 
general concepts, protocols, and devices currently used in LAN 
networking and WAN internetworking applications as discussed 
in the above referenced applications. 

Packets 

In the most common LANs and WANs in use today, data 
is transmitted among network devices and processed within 
devices as a series of independent packets, each packet 
containing at least one header having at least a destination 
address specifying an ultimate destination and generally also 
having a source address. Headers may also include other 
handling information such as an indication of the different 
protocols used to format a packet, a transmission priority, 
etc. 

Fig, 1 depicts an example of a packet as it may be 
transmitted on a network. The example shown is essentially an 
Ethernet packet, having an Ethernet header 202 and a 48-bit 
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Ethernet address (such as 00 : 85 : 8C: 13 : AA) 204 , and an Ethernet 
trailer 230, Within the Ethernet packet 200 is contained, or 
encapsulated, an IP packet, represented by IP header 212, 
containing a 32 bit IP address 214 (such as 199.22.120.33). 
Packet 200 contains a data pay load 22 0 which holds the data 
the user is interested in receiving or holds a control message 
used for configuring the network. Many other types and 
configurations of packets are presently known in the 
networking art and it is assumed that additional packet 
protocols will be developed in the future. 

Multiple-Destination Data Units 

A number of the networking standards referenced 
above provide a mechanism for a source in LAN or WAN to 
transmit a packet to all the nodes in the network. This 
situation may be referred to as a multipoint to multipoint 
communication . 

A multipoint to multipoint communication is one 
where multiple calling parties are communicating with multiple 
called parties (e.g., a party line, or a conference call). In 
a packet-based communication system, a packet generated by any 
one party must be (possibly duplicated) and sent to all the 
other parties so that they can all participate in the 
conversation. This is known as a multicast operation. 

In some cases, the party that generated the packet 
must also receive the packet it generated. This gives that 
party an indication that the packet it generated was multicast 
to all the parties in the communication. Within the same 
communication, it is also the case that certain parties may 
need this "echo" back to the generator of the packet, while 
other parties do not. 

In a multiprotocol environment, each of the parties 
in the communication may be located on different types of 
networks. Where the eventual message content of each packet 
must be identical, the encapsulation of the packet is based on 
the network that is carrying it. For example, if the packet 
was generated on network type A, then it consists of a message 
section M and the encapsulation A (A:M) . If the message must 
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be transported to two different networks B and C, then the 
packet on those networks will be in the format B:M and C:M, 
respectively. In addition, the original packet A:M may be 
sent back to the party on network A. 

In prior art systems, translations between protocols 
are accomplished individually within a network device. For 
example, in a multipoint conversation between A, B, and C, 
each communicating over a different protocol, a prior art 
network device will typically store three data structures, 
each having two substructures. A data structure will be 
defined for each possible transmitter, A, B, and C, and a sub- 
structure will be defined for each translation, such as A->B, 
A->C, B->A, B->C, C->A, C->B. Adding a new party to the 
conversation, such as D, in such a prior art system will 
require adding a new data structure with three substructures, 
D->A, D->B, D->C, and also adding substructures to each of the 
existing transmitters A->D, B->D, C->D. In general, in these 
prior art systems, a multiparty conversation between N nodes 
requires N 2 data substructures for routing. This somewhat 
cumbersome system is necessary because prior art network 
devices generally handle routing all packets by first looking 
up a data structure for the transmitter of the packet and then 
processing the packet according to just that particular data 
structure . 

What is needed is a mechanism that would allow a 
high performance communication device to quickly perform 
multipoint routing, possibly in hardware, while allowing the 
operation of the routing function and multicast group 
assignment to be specified and configured programmably so that 
it can be easily changed and can flexibly respond to different 
translation requirements of different network protocols. 

SUMMARY OF THE INVENTION 
In general terms, the present invention comprises 
techniques and devices for an improved handling of unitized or 
packetized data in a multipoint or similar transmission 
environment. More specific applications of the invention 
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include handling of multicast packet data in a network device 
such as a router or layer three switch . 

According to the present invention, a multicast 
group G is defined. This group consists of all the parties 
5 that are participating in the communication. As parties join 
the communication, they are allowed to join G and each party 
can leave G when it desires. In a specific embodiment, the 
representation of G is a circular linked list. Each party has 
one entry in the linked list, therefore the entire structure 

10 has N substructures for N participants. This provides a 

number of advantages over prior art systems that typically 
require N 2 substructures for N participants. Each entry has 
five fields. The first field indicates the amount of 
encapsulation that must be removed from the incoming packet to 

15 extract the message M. Note that this is different for each 
party because each one exists on a different type of network. 
The second field indicates the amount and content of 
encapsulation that must be added to the message M in order to 
create a packet for that type of network. The third field 

20 indicates the amount and content of encapsulation that must be 
added to the message M in order to create a packet for that 
type of network. The third field is the "echo" bit that 
indicates if the packet must be sent back to the originator of 
the message. The fourth field is the pointer to the next 

25 entry of the group G. The fifth field indicates the 
destination address of the packet. 

In a specific embodiment, the routine used to move 
through the circular linked-list and to translate data packets 
is performed by dedicated hardware logic, thereby allowing 

30 fast searching. However, the search is performed using a data 
structure stored in modifiable memory locations or registers. 
Thus, fast but flexible searching on packets may be performed. 

The invention also comprises a network operating 
with devices having multipoint processing as described herein. 

35 Additional aspects of the invention will be better 

understood upon reference to the following description of 
specific embodiments and the attached claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a diagram of a packet as an example of a 
type of data unit upon which the invention may be effectively 
employed. 

5 FIG. 2 is a diagram illustrating a layered network 

protocol. 

FIG. 3 is a flow chart illustrating a method of the 

invention. 

FIG. 4 is a block diagram of a network device 
10 incorporating aspects of the invention. 

FIG. 5 illustrates an example circular linked-list 
data structure within a memory according to the invention. 

FIG. 6 is a block diagram of a search engine and 
memory according to a specific embodiment of the invention. 
15 FIG. 7 is a block diagram of an alternative network 

device incorporating aspects of the invention 

FIG. 8 is a diagram of a network according to one 
embodiment of the invention. 

20 DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

Multicast Routing Operation 

FIG. 3 is a flow chart showing a multicast routing 
search operation according to one embodiment of the present 
25 invention and FIG. 4 is a block diagram of a network device 
(or element) 100 according to a specific embodiment of the 
invention. 

When a packet 101 comes in on a port (Step SI) , a 
multicast engine 104 looks up the data structure for the group 

30 address of the packet, indexed by the source address of the 
packet (Step S2) . The data structure indicates whether the 
packet needs to be echoed, and the packet is eventually echoed 
if so indicated by the data structure (possibly without 
stripping the heading from the packet) either before, during, 

35 or after other forwarding of the packet (Step S3) . The engine 
reads the data structure to determine what operation must be 
performed on the incoming packet to translate the packet to a 
shared group format M, which will generally be the message 
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portion of the packet (Step S4) , and then performs that 
translation (Step S5) . The engine looks in a pointer in the 
data structure to fetch the next data structure in the 
circular list (Step S6) . This data structure specifies what 
5 must be added to M to get a packet of the appropriate format 
for that destination (Step S7) . The engine performs the 
operation and forwards the packet (Step S7) , and then moves to 
the next data structure (Step S8) . Processing is repeated for 
each retrieved data structure until the data structure that 
10 the packet started with (Step S9) is reached. 

One specific example of a data structure for storing 
information about each member of a multicast group is shown in 
FIG. 5. As shown in the figure, the example data structure 
includes a first translation parameter for removing the A 
header to get M, a second translation parameter for adding an 
A header to M, an echo bit, a pointer to a next data structure 
in the circular list, and a destination address for A. 
According to an embodiment of the invention, this single 
multicast group data structure is all the information storage 
that is required to implement multipoint to multipoint on 
multiprotocol networks. Using the example of three networks 
A, B, and C, the packet originates on network A. The 
multicast processor recognizes this and identifies the 
multicast group G. The processor remembers the origin of the 
packet was on network A. The processor then strips off the 
encapsulation of A and saves the shared format portion. The 
processor traverses down the linked list to the entry for B. 
It creates the encapsulation for B using the second field in 
the entry. It then proceeds down the linked list to the entry 
for C. The encapsulation for C is created using the second 
field in this entry. The processor traverses the link to the 
entry for A. The processor knows that this is the origin of 
the packet. If the echo bit is set, then the processor 
creates an encapsulation for A and it then stops traversing 
the linked list. If the echo bit is not set, the process 
stops traversing the list without creating a packet to be sent 
back to the origin on network A. 
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Once all the required packets (encapsulating plus 
message) are ready, they are sent to the destinations as 
indicated in the fifth field of the entry. This single group 
G handles packets originating from all parties participating 
in the multipoint to multipoint communication. 

FIG. 6 shows a more detailed block diagram of 
routing engine 104 and memory 110 according to various 
specific embodiments of the invention. In this embodiment is 
depicted engine 104 including registers or similar memory 
locations for storing translation parameters such as header 
removal field 117a, header addition field 117b, echo flag 
117c, pointer 117d, and destination address 117e. Engine 104 
also includes a mechanism for storing an extracted message (M) 
112 and a translated packet 116. According to one embodiment 
of the invention, these registers are the alterable parameters 
of engine 104 which will otherwise perform its function using 
fast dedicated custom logic circuits. These alterable 
registers may be set up to default values by a management 
program. According to the invention, engine 104 is able to 
very quickly translate and then route a data packet according 
to the values specified in the registers 117a-e. 

While memory locations are shown within engine 104 
for sake of illustration of an embodiment, it will be 
understood that these alterable values may be stored in any 
type of memory to which engine 104 has fast access, including 
in a portion of system memory 110. 

Other Characteristics 

The invention, in various embodiments, provides a 
number of benefits in high performance network devices or in 
computer systems handling similar data. According to the 
circular list of the invention, individual transmitters or 
receivers may be trivially added or dropped from the group. A 
new transmitter or receiver is simply added to the circular 
list by creating a single data structure for that transmitter 
or receiver, and then changing just one pointer in the 
existing circular list while copying the previously chained 
pointer into it's own pointer field. 
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According to another aspect of the invention, the 
format of the shared format M can be adjusted for different 
groups depending on whether the group members all have a 
common protocol or all reside on a subpart of the LAN, 
potentially simplifying processing. The invention also allows 
for distributed and parallel processing of multiple incoming 
packets by using multiple engines, each referring to the same 
linked list, an example of which is shown in FIG. 7. 

It will also be apparent from the invention within 
the context of the prior art, that one implementation of the 
invention will allow for designing of dedicated fast logic 
circuitry to perform the translation of packets according to 
the data stored in the linked list, allowing the actual 
configuration of translation to be programmably configurable 
through setting data in the multipoint group data structure. 

In one embodiment, the invention may be incorporated 
into a wide area network (WAN) or local area network (LAN) as 
shown in FIG. 8 to allow efficient handling of group traffic. 
FIG. 8 shows the invention as embodied in a network with a WAN 
backbone 300 and LANS 310a-c. LAN 310s may be connected to 
the WAN backbone by a local router 304. 

The invention has now been explained in accordance 
with specific embodiments, however many variations will be 
obvious to those of skill in the art. In particular, the 
memory and data structure may be organized differently so long 
the general translation and linked-list method described 
herein may be performed. Also, the block diagram of FIG. 4 
and the description organize and group functional blocks in a 
particular way to provide a clear example. However, other 
organizations are possible. These enumerated examples are not 
exhaustive of possible alternative embodiments of the 
invention. The invention should therefore not be limited 
except as provided in the attached claims. 
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WHAT IS CLAIMED IS: 

1 1. A method of routing data units in a digital device 

2 to multiple destinations comprising: 

3 receiving a data unit from a source addressed to a 

4 group; 

5 retrieving a data structure for said source to said 

6 group, said data structure containing translation instructions 

7 to a shared message component and a pointer to a next data 

8 structure in a linked list; 

9 translating said data unit to a shared message 

10 component according to said translation instructions; 

11 retrieving a second data structure according to said 

12 pointer, said data structure containing translation 

13 instructions from a shared message component and a pointer to 

14 a next data structure; and 

15 translating said data unit from a shared message 

16 component according to said translation instructions. 

1 2. The method according to claim 1 wherein said 

2 translating is performed by dedicated logic circuits. 

1 3. The method according to claim 1 wherein parameters 

2 used in said translation are stored in memory and may be 

3 configured by operating system software of said digital 

4 device. 

1 4. The method according to claim 1 further comprising 

2 repeatedly performing said second retrieving and translating 

3 steps until a pointer to the initial data structure is 

4 retrieved. 

1 5. The method according to claim 1 wherein said 

2 translation may be performed by a plurality of translation 

3 engines in parallel such that a plurality of data units may be 

4 processed in parallel. 
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1 6. The method according to claim 1 wherein said 

2 translation is performed on data units consisting of 

3 encapsulated packets. 

1 7- The method according to claim 1 wherein an incoming 

2 data unit is processed into a shared message component by: 

3 removing header information from said data unit 

4 according to a rule stored in a register; 

5 storing a resultant shared message component. 

1 8. The method according to claim 1 wherein a 

2 substructure is created for each node added to a group of 

3 multiple destinations, such that the total number of data 

4 substructures for N nodes is of the order N. 

1 9. A method of building a data structure for routing 

2 data units to multiple destinations comprising: 

3 receiving a request from a node P to join a group G 

4 creating a substructure for said node P defining 

5 translation rules between said node P and a group message M; 

6 and 

7 attaching said substructure to a linked list for 

8 said group G; 

9 such that a group G consisting of N nodes comprises 
10 order N data substructures. 

1 10. A method for processing packets having multiple 

2 destinations comprising: 

3 setting up parameters in modifiable registers for 

4 translating incoming packets into a single shared format and 

5 for retranslating outgoing packets into different formats for 

6 different destinations; and 

7 using dedicated logic circuits to apply said 

8 parameters to said packets to route packets to multiple 

9 destinations. 

1 11. A network device for routing data units comprising: 
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2 an input for receiving a data unit directed to a 

3 group ; 

4 a search memory for storing a data structure for 

5 said group; 

6 a search engine for performing a search for a group 

7 data structure; and 

8 a packet processing routing unit for routing 

9 packets . 

1 12. The device according to claim 11 wherein said data 

2 structure is stored in said memory as a linked list of 

3 entries, one entry for each destination belonging to a group. 

1 13. A network for communicating data comprising: 

2 a plurality of network devices capable of routing 

3 network data units between sources and destinations; 

4 at least one network device comprising: 

5 an input for receiving a data unit directed to a 

6 group; 

7 a search engine for performing a search for a group 

8 data structure; 

9 a search memory for storing a data structure for 

10 said group; and 

11 a packet processing routing unit for routing 

12 packets. 

1 14. A network according to claim 13 further comprising: 

2 at least one network device capable of detecting a 

3 flow identification on an incoming data unit and routing said 

4 data unit according to said flow identification. 

1 15. A network according to claim 14 further comprising: 

2 at least one network device capable of adding a flow 

3 identification to an outgoing data unit. 
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